Density instabilities in a two-dimensional dipolar Fermi gas 
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We study the density instabilities of a two-dimensional gas of dipolar fermions with aligned dipole 
moments. The Random Phase Approximation (RPA) for the density-density response function is 
never accurate for the dipolar gas, and so we incorporate correlations beyond RPA via an improved 
version of the Singwi-Tosi-Land-Sjolander scheme. In addition to density-wave instabilities, our 
formalism captures the collapse instability that is expected from Hartree-Fock calculations but is 
absent from RPA. Crucially, we find that when the dipoles are perpendicular to the layer, the system 
spontaneously breaks rotational symmetry and forms a stripe phase, in defiance of conventional 
wisdom. 
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Ultracold atomic gases have thus far provided a ver- 
itable playground in which to explore quantum many- 
body phenomena. One of the field's great successes is 
the ability to tune the effective interatomic interactions 
via Feshbach resonances, thus allowing one to access the 
regime of strong correlations in a controllable manner. 
Furthermore, the ability to create tightly bound het- 
eronuclear Feshbach molecules with a permanent electric 
dipole moment provides a promising system in which to 
study many-body physics with long-ranged dipole-dipole 
interactions (for a review see, e.g., Ref. Indeed, such 
polar molecules can have interactions that are several or- 
ders of magnitude larger than those for atomic magnetic 
dipoles 0. 

Of particular interest are fermionic polar molecules 
confined in two-dimensional (2D) geometries: fermionic 
''"K^^Rb molecules have been very recently created Q, 
cooled down to quantum degeneracy and their life- 
time increased by the confinement in 2D However, 
correlations are expected to be enhanced in 2D compared 
to 3D, and thus a major challenge is how to describe the- 
oretically such correlations in the dipolar system. It is 
this issue that we will address in this Letter. 

We focus on a dipolar Fermi gas in a single layer, 
where the dipole moments are all aligned by an exter- 
nal electric field E, making an angle 9 with respect to 
the normal of the 2D x — y plane (inset of Fig. [Ij. Even 
for this simple 2D geometry, the anisotropic interactions 
provide an exotic twist to the problem and a rich phase 
diagram is expected. For sufficiently large tilting angles, 
> arcsin(l/-\/3), the interaction develops an attrac- 
tive sliver in the plane, eventually leading to p-wave su- 
perfluidity 0. For small tilting angles 6* 7^ 0, the re- 
pulsive, anisotropic interaction is expected to give rise 
to anisotropic density- wave (stripe) phases 0, 01, be- 
fore eventually yielding a Wigner crystal at sufficiently 
high densities and/or strong interactions However, 
in Refs. 0,0]: the basic description of the stripe phase is 
derived from the Random Phase Approximation (RPA) 
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FIG. 1: (Color online) Phase diagram for a 2D dipolar Fermi 
function of the dipole orientation angle 9, as de- 
fined in the inset, and dimensionless interaction strength 
U = mD^kp jh?" , where D is the dipole moment and kp \s, 
the Fermi wave vector. The (green) circles mark the transi- 
tion to a stripe phase while the (red) triangles correspond to 
the collapse instability, all derived using our improved STLS 
formalism. For comparison, we include the RPA result for 
the stripe instability (dashed [green] line), the Hartree-Fock 
result for the collapse instability (stripe pattern [red] region), 
and the area where p-wave superfluidity is exgected to occur 
(shaded [violet] region), as predicted by Ref. 



for the density-density response function, and this is not 
expected to be accurate for the 2D dipolar Fermi gas: 
As well as neglecting the exchange correlations resulting 
from Fermi statistics, RPA fails to correctly describe the 
long wavelength regime of the density-density response 
function, unlike in the case of the 2D electron gas. Fur- 
thermore, RPA does not settle the question of whether 
or not the 2D dipolar Fermi gas spontaneously breaks ro- 
tational symmetry and forms a stripe phase for isotropic 
interactions (^ = 0), which is of fundamental interest to 
other quasi-2D systems such as the cuprate superconduc- 
tors [ifl. 

In this Letter, we include correlations beyond RPA 
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using an improved version of the Singwi-Tosi-Land- 
Sjolander (STLS) scheme [ll|, which has had much suc- 
cess in describing electron systems [l2|. Using this for- 
malism, the effect of correlations is evident in the pair 
correlation function, where we observe a "correlation 
hole" forming around each fermion with increasing in- 
teraction. We map out the instabilities of the density- 
density response function and we see the existence of 
a stripe phase, similarly to RPA, though for consider- 
ably larger dipole strengths and/or densities. However, 
in contrast to RPA, we also observe a collapse instability 
for sufficiently large 0, which is consistent with Hartree- 
Fock calculations 1^, @, [13, [3|- Last but not least, we 
show that the system does indeed spontaneously break 
rotational symmetry to form a stripe phase when 6 — 0. 

The effective 2D dipolar interaction for aligned dipoles 
confined in a layer of width W can be evaluated as per 
Ref. [isj . Parametrizing the x-y in-plane momentum in 
polar coordinates q = {q, 0) (</> = corresponds to the 
direction x of the dipole tilt in the inset of Fig. [T]) , in the 
limit qW <C 1 (the expected regime of the experiments) , 
the 2D interaction can be written as: 



v{q, 0) = Vb - 2TTD^q (cos^ 



sin^ 6 cos^ 



4>) , (1) 



where D is the dipole moment. Vq corresponds to the 
short-ranged contact interaction, which depends on the 
confinement, and the confinement width W provides a 
natural cut-off for the quasi-2D system: A ^ 1/W » kp. 
The dipolar system is parametrized by the angle 6 and 
the dimensionless interaction strength U = mD^kp /f? , 
where m is the fermion mass and kp — •\/47rn is the Fermi 
wave vector (n is the density). Note that the effective 
coupling increases with increasing density, in contrast to 
the case of Coulomb interactions, where the regime of 
strong coupling corresponds to low densities. 

In the following, we analyse the inhomogeneous phases 
of a 2D dipolar Fermi gas using the linear response 
theory. Here, the linear density response (Sn(q, w) to 
an external perturbing potential y^^*(q, oj) defines the 
density-density response function x(q:<^) in frequency 
and momentum space: 



<5n(q,c.) = x(q,^)F^"*(q,c.) 



(2) 



In the static limit, uj — 0, the appearance of a divergence 
in X at a particular wave vector qc signals an instability 
towards the formation of a density wave with period set 
by qc. Note that if the instability only depends on the 
magnitude qc = jqd and is insensitive to the angle 0, 
then the inhomogeneous phase may consist of multiple 
density waves, so that it forms, e.g., a triangular lattice 
rather than a stripe phase. 

In addition to density instabilities, we can use the 
fluctuation-dissipation theorem to extract the ground- 
state correlation functions from f^)- A standard 
quantity is the pair correlation function g{v2 ^ Vi) — 



■^{ijj'^ [T2)ti^'^ {Yi)tp{Yi)tl;{Y2)) , where (• • • ) is the expecta- 
tion over the ground state and V'^r) is the creation op- 
erator for a spinless fermion at position r. This is related 
to the static structure factor S'(q) by: 
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[5(q) - 1] 
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which, in turn, is connected to the response function via 

^(q) = / d^x(q,»^)- (4) 



Note that here the integration is performed along the 
imaginary frequency axis. 

For a non-interacting 2D Fermi gas at zero tempera- 
ture, the response function can be evaluated exactly [l^ , 



n(q,^c.) = — K/2 



with a — — b— 
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' and b = If we insert H(q, iuj) 
into (|H) to obtain the non-interacting structure factor 
S'o(q); and then use Eq. wc find that 17(0) = (see 
Fig. [3]), as expected from Pauli exclusion. 

For fermions interacting via a two-body potential v{q), 
one often relies 0, Q upon the RPA to estimate x- Here, 
the response is that of a non- interacting system, H(q, w), 
to an external potential which includes an effective po- 
tential due to the perturbed density, i.e., one replaces 
V'^^^{c{,uj) in ^ with F'^^*(q,cj) -|- u(q)(5n(q, a;), giving 
Xflp^(q, w) = n^^(q, cj) — w(q). However, as discussed 
below, RPA is never accurate for dipolar interactions. 

We account for correlations beyond RPA by including 
a local field factor G'(q) in the response function 12|: 



x(q,'^) 



H(q,u;) 



l-v{ci) [l-G(q)]H(q,c^) 



(5) 



Physically, G'(q) corresponds to the corrections to the 
RPA effective potential that stem from correlations be- 
tween fermions. For example, at short distances (large 
q) the interactions will be suppressed by Pauli exclu- 
sion, thus giving G = 1. These exchange correlations, 
which are crucial in a gas of identical fermions, are 
clearly neglected by RPA. In addition, we can also ex- 
tract the behavior of G in the opposite limit g — > 
using the compressibility sum rule [12], which re- 
lates x^^(q — > 0, 0) to the inverse compressibility = 
■n? d"^ {ne) / dn^ , where e is the ground state energy per 
particle. For Coulomb interactions in electron systems, 
where u(q) oc the Hartree- Fock calculation for e 

gives us G(q) ~ lOq/ {?>Tikp) as g -> 0, thus confirming 
that G 0: RPA is therefore a reasonable approxima- 
tion for long wavelengths . This is not however true in 
the case of dipolar interactions: If we perform the same 
procedure, where we take 6 = in Eq. ([1]) for simplicity. 
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then we find that G(0) = 1 - 32h'^U / {3mVo) in the limit 
[/ <C 1, where the Hartrec-Fock result ([7]) is valid. Thus 
we see that Xrpa is never recovered in this case, even in 
the weak-coupling limit. In sum, the RPA for 2D dipolar 
Fermi gases fails at both short and long wavelengths [l^ . 

We instead determine G(q) using the STLS scheme, 
which provides an ingenious way in which to feed back the 
correlations in x(q, w) into G(q). STLS uses a classical 
analogy for the system's response to obtain [11 1 



G(q)=-- 



l f dk q-kw(k) 



[5(q-k)-l] 



(6) 



Note that the RPA case of G = implies that 5(q) = 1 
here, which in turn corresponds to setting g{r) = 1, i.e. 
neglecting any correlations in the STLS classical anal- 
ogy. Combining Eq. (jH]) with Ec^. gives us a set of 
self-consistent equations for G(q) that can be solved it- 
erativcly. If we start by inserting 5*0 (q) into Eq. (|6]) 
(which is equivalent to setting G'''-'(q) ~ 1 at the be- 
ginning of the iteration), then G^^''(q) incorporates ex- 
change correlations only. In particular, if we have purely 
contact interactions w(q) = Vq, then Eq. ^ returns 
G(i)(q) = 1 - 5(0) = 1. Thus, we see that STLS cor- 
rectly gives us a non-interacting response for a gas of 
identical fcrmions with contact interactions. 

For the dipolar interaction ([1]), one can show that G(q) 
calculated from Eq. ^ will also render x(q, w) indepen- 
dent of Vo provided g{0) = 0. However, similarly to 
what happens in the electronic Coulomb case 12|, the 
STLS scheme does not guarantee that g{0) = for the 
converged solution and so we obtain an unphysical de- 
pendence on Vo- In addition, we find that the density in- 
stabilities determined using this procedure are sensitive 
to the cut-off A at large q even though we have Qc < 2kp. 

To address these issues and better model the dipolar 
gas, we improve the STLS scheme by imposing, at each 
iteration step, the constraint g{Q) ~ and the fact that 
x(q, w); and thus S{q), will be dominated by Pauli ex- 
clusion for q ^ 2kp. Similarly to Ref. [l3|, we achieve 
this by adding a corrective function 6S{q) to the S{q) 
defined by Eq. (jj]) and then using S + 6S to determine 
G(q). In particular, we use the ansatz 



6Siq) = (^o(q) - ^(q) + Ae'^" Z^^'^-^") (l 



-q~/(2kf 



to interpolate between the STLS result for q < 2kp and 
the non-interacting one 5*0 for q ^ 2kp, where exchange 
correlations dominate. The constant A adjusts the be- 
havior near q = 2k p and is chosen at each iteration 
step so that 51(0) = 0. Note that the correction around 
q ~ 2kp is generally small. Our improved STLS pro- 
cedure thus renders x(q, 1^) insensitive to both Vq and 
cut-off A ^ 2kp, as required. 

We have confirmed that our converged solution for 
U ^ 1 agrees with the weak-coupling Hartree-Fock re- 
sult. In this limit, the Hartree-Fock approximation for 
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FIG. 2: (Color online) Behaviour of the static structure fac- 
tor S{q, (f>) and the rescaled inverse density-density response 
function, \l{q, uj — Q)/x{q,(j)',oj = 0), as the stripe instability 
at = 7r/2 is approached for 9 = 0.1. The vertical dashed line 
marks the position of the unstable wave vector qc — l.bAkp. 



the dipolar gas gives us a ground-state energy per parti- 
cle: 



h^kl 
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457r 



C/(3cos2 61 - 1) 



(7) 



Here, we only consider up to first-order in U for the en- 
ergy density Ehfi and thus we have neglected the higher 
order terms due to Fermi surface deformations induced 
when 6* ^ 3. We compare this expression with the 
ground state energy density extracted from our STLS 
solution for x(qjw) using the following relation for the 
interaction energy per particle: 
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dq 



v{q) [S{q) 1] (8) 



and then employing the Hellman-Feynman theorem |12l . 
[l7| . By doing this, we find that the ground state energy 
density obtained via the STLS calculation recovers the 
Hartree-Fock result ([7]) when [/ <C 1. Equivalently, we 
recover ehf if we impose S'(q) = 6*0 (q) in Eq. (|8]). 

Using our procedure, we analyse the density instabil- 
ities of the converged solutions for x(q, oj). For tilted 
dipoles {9 ^ 0), x(Q;0) is niost unstable towards form- 
ing a density wave along cj) = 7r/2, as shown in the 
Fig. [T] inset. Referring to the phase diagram in Fig. [TJ 
we find that this stripe phase exists for sufficiently large 
U when 9 < 7r/4. RPA also predicts a stripe transi- 
tion for 1/U = 2co^9 once one sets Vq = in Eq. ([T]) 
(cf. Refs. 0,i). However, we see that correlations shift 
the transition to a much higher U compared to the RPA 
result, thus giving p-wave superfiuidity a sizeable re- 
gion of existence around 9 = it/ A. Moreover, we find that 
qc < 2k p rather than qc = 2k p as expected from RPA. 
Figure [5] shows how x(q, 0)~^ tends toward zero (i.e. how 
x(q, 0) diverges) as we approach the stripe transition at 
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FIG. 3: (Color online) Pair correlation function g{r) of a 2D 
dipolar Fermi gas at ^ = with and without interactions. 
Note that we must always have g{0) — for a gas of identical 
fermions. Increasing the repulsive interaction U decreases the 
likelihood of two fermions being close together, thus resulting 
in a "correlation hole" near r = for U > 1. 



fixed 9. The divergence in x(q, 0) leads to a singularity in 
Eq. (Ill) , thus yielding a corresponding peak in the struc- 
ture factor S{q,(p) at q ~ Qc- Once x(q, 0)"^ hits zero 
at the stripe transition, we find that we no longer obtain 
convergence of the self-consistent equations (|H) and (jB]) 
when we increase U further. 

For the isotropic case (0 = 0), one might expect the in- 
homogeneous phase to maximise its rotational symmetry 
by forming a triangular lattice. However, we instead find 
that the system spontaneously breaks rotational symme- 
try to form a stripe phase. We see this by setting G^"' (q) 
to a converged solution for small 6 and U, and then ex- 
amining whether or not the iteration procedure for 9 = 
amplifies or suppresses the spread in (jj. From the fi- 
nal converged solutions, we find that x(Qj 0) exhibits a 
large spread in at C/ = 6, before eventually diverging 
for a specific <j> a,t U ^ 6.03. Here, the direction of the 
stripe is simply determined by the original (f) dependence 
of G''°-'(q). Thus, we see that the system is unstable to- 
wards breaking rotational symmetry and spontaneously 
forming a stripe phase [2^. There is also the possibility 
that the system first forms a nematic phase, similar to 
that discussed in Ref. [Toj . before forming a stripe phase. 

If we neglect any dependence on and consider G 
and S to be functions of q only, then we never see a 
transition to an inhomogeneous phase. However, we do 
see evidence of strong correlations in the pair correla- 
tion function (Fig. [3]) and a peak in the structure factor 
that suggests an imminent transition. Such a behavior is 
consistent with a first-order transition to a Wigner crys- 
tal phase. If this transition is similar to that of dipolar 
bosons, then it is expected to occur at [/ ~ 60 |20l422| . 

As 6 increases towards 7r/2 in Fig. [l] we instead find 
that the system can be unstable towards collapse, where 
gc = at the instability. In this case, x(q, 0) is most 
unstable for cf) = 0, which implies that the system exe- 
cutes an anisotropic collapse in the direction of the dipole 
tilt, a physically reasonable scenario. Contrast this with 



RPA, where one only ever has qc > 0. Sun et al. use 
a perturbative expansion of x(qj 0) around q = to ar- 
gue that one never has instabilities with = in the 
2D dipolar gas. However, their argument rests on the as- 
sumption that x(q; 0) is analytic at q = 0, as is the case 
with RPA, while we find that our x(q, 0) depends on (j) 
at q = and is thus non-analytic. This non-analytic 
behavior at q = may, at first sight, appear surpris- 
ing for a Fermi liquid, but it merely corresponds to an 
anisotropic compressibility, which is physically reason- 
able for anisotropic interactions. Moreover, it is consis- 
tent with the collapse predicted from Hartree-Fock cal- 
culations [i,i,[i3,[ll, as depicted in Fig.lH We recover 
the Hartree-Fock calculations for the collapse by using in 
Eq. ^ the exchange-only field factor G''^''(q) previously 
discussed. The Hartree-Fock approximation should be 
accurate for the collapse instability since the instability 
simply corresponds to the point at which the attractive 
interaction exceeds the effective repulsive interaction de- 
rived from Pauli exclusion. However, we do not expect 
such an approximation to be accurate for the stripe insta- 
bility since we require correlations beyond the exchange 
ones in this case. Indeed, the conserving Hartree-Fock 



calculation employed in Refs. [IJ, [IJ] is expected to un- 
derestimate the interaction at which the stripe transition 
occurs, as stressed in Ref. [l3| . This explains the quan- 
titative disagreement between our phase boundary and 
that of Refs. ^E^. 

Despite the apparent success of our improved STLS 
scheme for the dipolar gas, there are still some incon- 
sistencies that it shares with the original STLS scheme 
for electron systems. Specifically, the pair correlation 
function can become slightly negative at short distances 
(Fig. [3|) and the compressibility sum rule is systemati- 
cally violated for a range of interaction strengths U <3. 
However, our scheme is a substantial improvement over 
RPA and we expect it to provide a basis upon which to 
investigate correlations in other dipolar Fermi systems 
such as multilayers. 

Our predicted stripe phases should be experimentally 
realizable with polar molecules, where the density modu- 
lations could be probed using Bragg scattering. The typ- 
ical density of polar molecules in a 2D layer is 10* cm~^, 
which gives a maximum of U ~ 0.3 for KRb molecules 
with dipole moment D ^ 0.2 Dcbye as in the experi- 
ment [5|. Thus, to access the stripe phase with current 
experiments, one needs to enhance U by, e.g., increasing 
the effective mass using an in-plane optical lattice. Al- 
ternatively, one could use LiCs molecules which have a 
dipole moment of up to 5.5 Debye [l^l, thus allowing one 
to explore the stripe transition for the whole range of 9. 
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